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VO? A METHOD AND APPARATUS FOR 
IMPROVED PREDICATE PREDICTION 



FIELD OF THE INVENTION 
5 The present invention relates to computer systems and more particularly to 

computer system processors that support predication and perform predicate 
prediction. 

BACKGROUND OF THE INVENTION 

A processor manipulates and controls the flow of data in a computer system. 
$0 Increasing the speed or throughput of the processor will tend to increase the 

computational power of the computer. Processor designers employ many different 
techniques to increase processor speed and throughput to create more powerful 
computers for consumers. One technique used by designers is called predication. 
Predication is the conditional execution of instructions depending on the 
1 5 value of a predicate. For example, consider the following sequence of instructions: 
5 COMPARE R1 = R2 -> p2 

(p2) ADD R3 + R4 -> R5 
The first instruction, COMPARE R1 = R2 p2, determines a value for the predicate 
p2 based on a comparison of the operands R1 and R2. If the value of register R1 is 
20 equal to the value of register R2, then the value of predicate p2 is set to "True", and 
if the values of R1 and R2 are not equal, then p2 is set to "False." "True" and 
"False" are typically represented in the processor as single bit values "1" and "0", 
respectively, (or "0" and "1", respectively, in a negative logic implementation). 
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The second instruction, (p2) ADD R3 + R4 -> R5, includes two parts. The 
first part, (p2), predicates (or conditions) the second part, ADD R3 + R4 -> R5, on 
the value of predicate p2. If P is true ( e.g. a "1"), then the value of R5 is set equal 
to the value of R3 + R4. If p2 is false (e.g. a "0"), then the second part of the 
instruction is skipped (essentially treating the instruction like a no-op) and the 
processor executes the next sequential instruction in the program code sequence. 

Unfortunately, the COMPARE instruction can take a long time to execute. 
Because of this, the execution of dependent, subsequent instructions, such as the 
ADD instruction, may be delayed until the COMPARE instruction completes 
execution. The present invention address this and other problems. 

SUMMARY OF THE INVENTION 

A method and apparatus for performing predicate prediction is described. In 
one method, the least significant bits (LSBs) of a first operand are compared to the 
LSBs of a second operand. The result of this comparison is used to determine a 
predicted predicate value for a predicate. A predicated instruction is then 
conditionally executed depending on the predicted predicate value. 

Other features and advantages of the present invention will be apparent from 
the accompanying figures and the detailed description that follows. 
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The present invention is illustrated by way of example and not limitation in the 
accompanying figures in which like references indicate similar elements and in 
which: 

Figure 1 is a state diagram for a predicate predictor formed in accordance 
with an embodiment of the present invention; 

Figure 2 is a comparator formed in accordance with an embodiment of the 
present invention; 

Figure 3 is a predicate predictor formed in accordance with an embodiment of 
the present invention; 

Figure 4 is computer system formed in accordance with an embodiment of 
the present invention; and 

Figure 5 is a flow chart showing a method of the present invention. 

DETAILED DESCRIPTION 

A method and apparatus for performing predicate prediction is described. In 
accordance with one embodiment of the present invention, a predicate value is 
predicted using either historical information or by comparing a selection of least 
significant bits (LSBs) of the two operands of the COMPARE instruction that 
determines the predicate value. If the predicate predictor has determined a high 
confidence in its ability to accurately predict a predicate value based on historical 
information associated with the predicate, then the historical information is used to 
determine the predicted predicate value (PPV). If, on the other hand, the predicate 
predictor has a low confidence in its ability to accurately predict a predicate value 



based on the historical information, then the PPV is determined by comparing the 
LSBs of the first operand to the LSBs of the second operand. Once the PPV is 
determined for a predicate, an instruction that is predicated on the predicate is 
conditionally executed, depending on the PPV, by either executing the instruction 
normally or treating the instruction like a no-op. 

After the COMPARE instruction completes execution, the resulting actual 
predicate value (APV) is compared to the PPV to determine the accuracy of the 
prediction. If the prediction was correct, execution of subsequent instructions 
continues normally. If the prediction was incorrect, the backend portion of the 
processor pipeline is flushed, and the instructions are re-executed beginning with 
the predicated instruction, using the APV for the predicate value. The APV is also 
used to update the historical information associated with the predicate stored in a 
predicate history table. 

A more detailed description of embodiments of the present invention, 
including various configurations and implementations, is provided below. For 
simplicity, the terms "predicate register", "predicate", "predicate ID", and "predicate 
value" may be used interchangeably, and the terms "register", "register ID", "register 
value", and "operand" may also be used interchangeably. For example, "predicate 
prediction" is understood to mean, more precisely, "predicate value prediction." As 
another example, "comparing a first register to a second register" is understood to 
mean, more precisely, "comparing a value stored in the first register to a value 
stored in the second register." 

Consider, again, the following sequence of instructions: 



COMPARE R1 = R2 p2 
(p2) ADD R3 + R4 R5 
As described above, the first instruction determines a value for the predicate p2. 
The second instruction is a predicated instruction, the execution of which is 
5 predicated (or conditioned) on the value of predicate p2. In a highly pipelined 
processor, the COMPARE instruction may take severalclocks to complete 
execution. To prevent the ADD instruction from being delayed by these clocks, the 
value of predicate p2 is predicted, and the ADD instruction is then conditionally 
Qi executed depending on the PPV of p2. 

"s\ii\ 

;l40 Figure 1 is a state diagram for a predicate predictor formed in accordance 

with an embodiment of the present invention in which two states are defined. For 

illll 

simplicity, this state diagram is described with reference to the sequence of 
instructions discussed above. 
j $! In state 100, the PPV for predicate p2 is calculated by the predicate predictor 

Hf5 using the historical information associated with predicate p2. If the APV for p2 is 
determined to be equal to the PPV after executing the COMPARE instruction, then 
the prediction was correct. Correct predictions may establish a high confidence 
level in the ability of the predicate predictor to accurately calculate a PPV for p2 
based on the historical information. Because the confidence level is high, a 
20 subsequent prediction for p2 is also made based on this historical information the 
next time the instruction sequence is encountered in the program code. 
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If, however, the APV is not equal to the PPV, then the prediction is incorrect. 
The confidence level may drop due to the misprediction for p2. If the confidence 
level drops below a threshold, the state machine transitions to state 101 of Figure 1. 
This state represents the operation of the predicate predictor when there is a low 
confidence in the ability of the predictor to accurately calculate a PPV for p2 based 
on the historical information associated with p2. After transitioning to state 101, a 
subsequent prediction for p2 is made based on a comparison of the LSBs of the 
operands of the COMPARE instruction, R1 and R2, rather than using historical 
information for p2. 

For one embodiment of the present invention, the predicate predictor 
calculates a first confidence level in its ability to accurately calculate a PPV for p2 
based on historical information. The predictor also calculates a second confidence 
level in its ability to accurately calculate a PPV for p2 based on LSB comparisons. 
High and low confidence levels are then determined by comparing the two 
calculated confidence levels to each other, thereby establishing a variable 
confidence level threshold. For an alternate embodiment, only a single confidence 
level is calculated by the predictor, and this confidence level is compared to a 
predetermined threshold to delineate high and low confidences. For purposes of 
this discussion, stating that the predicate predictor has a high or low confidence in 
its ability to accurately calculate a PPV for a predicate based on historical 
information is equivalent to stating that the predicate predictor has a low or high 
confidence, respectively, in its ability to accurately calculate a PPV for the predicate 
based on operand LSB comparisons. 
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If the confidence level rises above the threshold, then the predicate predictor 
transitions back to state 100 of Figure 1. As a result of this transition, a subsequent 
PPV for p2 is calculated by the predicate predictor using the historical information 
associated with p2 rather than using a comparison of the LSBs of the operands. For 
an alternate embodiment of the present invention, the state diagram may include 
additional states such as a state in which the processor is stalled until the APV for 
the predicate is determined. 

saure 2 is a comparator formed in accordance with an embodiment of the 
'present invehtion in which the LSBs of the operand stored in register R1, 201, are 

A \^ 

ijO compared to the l>S^Bs of the operand stored in register R2, 202 to determine a 
i PPV. In accordance Wiethe embodiment of Figure 2, only the least significant five 
}; bits of the 64-bit operands arfevcompared within comparator 203 to determine a 

PPV. Bits a(0) and b(0), a(1) and ibq), a(2) and b(2), a(3) and b(3), and a(4) and 
I b(4) are compared for equality using XOf^gates 210, 211, 223, 213, and 214, 
^1 5 respectively. The output of each of XOR gafee 21 0-214 is provided to the input of 
NOR gate 220, the output of which is PPV. For tms embodiment, a PPV of 1 
indicates that the least significant five bits from the opefcsmd of register 201, a(0) - 
a(4), are equal to the least significant five bits from the operand of register 202, b(0) 
- b(4). A PPV of 0 indicates that the bits are not equal to each otnfer. 
20 In accordance with one embodiment of the present invention, comparing the 

LSBs of two operands may generate a result faster than comparing all the bits of the 
operands. This may be due to, for example, fan-in limitations of the logic gates of a 
comparator. The fan-in limitation may necessitate a time consuming, extended 



cascade of logic gates to compare all the bits of the operands. By comparing only 
the LSBs of the two operands, rather than all the bits, a fast, two level cascade, 
such as the one shown in Figure 2, may be used. 

In general, if the two operands are close in value, then a comparison of a 
5 sufficient number of LSBs of the operands can predict the result of comparing all the 
bits of the operands. The number of LSBs to be compared to generate a PPV for 
the predicate may be determined by appropriately balancing PPV accuracy, 
comparator size, and comparator speed. For example, as the number of LSBs that 
P are compared increases, PPV accuracy also increases, but comparator size may 
!Hlo also increase and comparator speed may decrease. Conversely, as the number of 
B LSBs that are compared decreases, comparator size also decreases and 
fl comparator speed increases, but PPV accuracy may decrease. 
M : For one embodiment of the present invention, the least significant quarter or 

l= v less of the operand bits are compared to determine the PPV. For 64-bit operands, 
3 15 this amounts to the least significant 16 bits of each operand. For another 

embodiment, the least significant eighth or less of the operand bits are compared to 
determine the PPV. For 64-bit operands, this amounts to the least significant byte 
of each operand. Note, however, that the present invention is not limited to 64-bit 
operand sizes. Any number of operand sizes may be used in conjunction with 
20 alternate embodiments of the present invention. In addition, any number of LSBs 
less than the total number of bits in the operand may be compared to a 
corresponding number of LSBs of another operand to determine the PPV. 
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Although the comparator in Figure 2 determines if the LSBs are equal, 
comparators formed in accordance with alternate embodiments of the present 
invention may compare for any mathematical relationship between the LSBs or any 
other portion of bits of the operands. For example, for an embodiment in which a 
predicate is determined by a COMPARE instruction that determines if a first operand 
is greater than or equal to a second operand, the comparator calculates the PPV by 
determining if the LSBs or most significant bits (MSBs) of the first operand are 
greater than or equal to the LSBs or MSBs of the second operand, respectively. For 
an embodiment in which a predicate is determined by a COMPARE instruction that 
determines if a first operand is less than a second operand, the comparator 
calculates the PPV by determining if the LSBs or MSBs of the first operand are less 
than the LSBs or MSBs of the second operand, respectively. 

Figure 3 is a predicate predictor formed in accordance with an embodiment of 
the present invention. Predicate history table 301 stores historical information 
associated with each of any number of instructions, and is indexed by instruction 
pointers (IPs). In addition, table 301 stores the confidence level associated with the 
IP. Register file 302 stores the register values associated with any number of 
registers. The outputs of table 301 and register file 302 are coupled to the inputs of 
PPV calculator 303, the output of which is coupled to an input of speculative 
predicate register file (SPRF) 304. One output of SPRF 304 is coupled to the PPV 
input of processor pipeline 305, and another output of SPRF 304 is coupled to an 
input of XOR gate 306. Instructions 300, after having been decoded by a decoder 
(not shown), are provided to the input of pipeline 305 as well as to IP, register, and 
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predicate select circuitry coupled to predicate history table 301, register file 302, and 
SPRF 304, respectively. For one embodiment, this select circuitry comprises a 
multiplexer. The APV output of pipeline 305 is coupled to an input of XOR gate 306 
and to an input of predicate history table 301 . The output of XOR gate 306 is 
coupled to the flush signal input of pipeline 305. The IP output of pipeline 305 is 
coupled to the IP select circuitry of table 301, and the predicate ID output of pipeline 
305 is coupled to the predicate select circuitry of SPRF 304. The register value 
output of pipeline 305 is coupled to an input of PPV calculator 303. 

To demonstrate the operation of the predicate predictor of Figure 3, consider 
the execution of the sequence of instructions described above. After the processor 
fetches and decodes the first instruction, COMPARE R1=R2 -> p2 t the IP of the 
instruction is provided to the predicate predictor of Figure 3 from block 300. The IP 
of the COMPARE instruction is used to select the appropriate location from 
predicate history table 301. The historical information and confidence level 
associated with this instruction (and, hence, the historical information associated 
with p2) is read from table 301 and provided to PPV calculator 303. Simultaneously, 
the register IDs of R1 and R2 are used to select the appropriate operands from 
register file 302. A selection of the LSBs of the operands R1 and R2 are read from 
table 301 and provided to comparator 312 within PPV calculator 303. Comparator 
312 includes circuitry that is constructed and operates in a manner similar to 
comparator 203 of Figure 2. 
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For one embodiment of the present invention, the historical information stored 
in table 301 of Figure 3 may include any number of bits, and history-based 
prediction circuit 31 1 of PPV calculator 303 may use these bits in conjunction with 
conventional branch prediction techniques to calculate a PPV for p2. For example, 
a two bit up-down counter or bimodal prediction technique may be used to tolerate a 
single, inaccurate PPV within a series of accurate PPVs for p2. Local or global 
prediction techniques may also be used, or, alternatively, a combination of 
techniques may be used in, for example, a chooser predictor. 

The historical information stored in predicate history table 301 of Figure 3 
may include information related to program history, context correlation, or PPV 
accuracy rates. For an alternate embodiment of the present invention, some or all 
of history-based prediction circuit 31 1 within calculator 303 may be merged into 
predicate history table 301. In this manner, the PPV based on historical information 
may be calculated and stored in the table rather than calculated "on the fly" by 
calculator 303. For an alternate embodiment of the present invention, predicate 
history table 301 is indexed by the predicate ID of the associated predicate (e.g., p2 
in this example) or by the IP of the predicated instruction that uses the PPV 
calculated by calculator 303. 

Confidence levels are also stored in table 301 of Figure 3. For one 
embodiment of the present invention, these levels reflect the relative confidence in 
the accuracy of a predicate prediction based on the historical information. If the 
confidence level in the accuracy of predictions based on historical information 
associated with p2 is high (i.e. above a threshold), then the PPV for p2 is 
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determined using the historical information. If, however, the confidence level is low 
(i.e. below a threshold), then the PPV for p2 is determined by comparing the LSBs 
of the operands of R1 and R2. A selector, including multiplexer 313, within PPV 
calculator 303 of Figure 3 selects the PPV to be based on either the historical 
5 information from history-based prediction circuit 31 1 or the comparison of LSBs from 
comparator 312. Multiplexer 313 has a first input coupled to the output of history- 
based prediction circuit 31 1 and a second input coupled to the output of LSB 
comparator 312. The control input of multiplexer 313 is controlled by the confidence 

^ level from table 301 , and the output of the multiplexer is the PPV output of PPV 

|| 0 calculator 303. 

W Note that the LSBs of the operands R1 and R2 from register file 302 may 

;W take some time to arrive at comparator 312 within PPV calculator 303 of Figure 3. 

r,L ; This delay may be due to, for example, a long distance between register file 302 

0 

Q and calculator 303. For example, register file 302 and calculator 303 may reside in 
Q 5 separate units of the processor. Alternatively, the delay may be due to a read-after- 
write hazard on R1 or R2. For one embodiment of the present invention, the delay 
is reduced by coupling calculator 303 to the register bypass bus from pipeline 305. 
This bus is represented as the coupling between the register value output from 
pipeline 305 to the input of LSB comparator 312 in PPV calculator 303. Note that 
20 this bus may also be coupled to register file 302 as well (not shown) to update the 
register values in file 302. 

Despite the use of the bypass bus, the historical information and confidence 
level from table 301 may arrive at PPV calculator 303 of Figure 3. before the 
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operands R1 and R2 arrive at the calculator. As a result, a PPV for p2 based on 
historical information may be calculated before the PPV based on LSB comparisons 
is calculated. Therefore, in accordance with one embodiment of the present 
invention, PPV calculator 303 provides an early prediction, based on historical 
information, to SPRF 304 when the confidence level is determined to be high. 
Calculator 303 provides a late prediction, based on LSB comparisons, to SPRF 304 
when the confidence level is determined to be low. 

The PPV for p2, after being calculated by calculator 303 of Figure 3, is then 
entered into SPRF 304 where the PPV awaits access by a subsequent instruction 
that is predicated on p2. In accordance with one embodiment of the present 
invention, SPRF 304 is a register file that includes PPV storage locations for all 
predicates. Speculative predicates (i.e. PPVs) that have not yet been committed to 
an architectural state are stored in SPRF 304 at the proper location. For an 
embodiment of the invention in which the processor architecture provides for 64 
predicates, SPRF 304 includes 64 locations, p0-p63, in which PPVs may be stored. 

In parallel with the activities of the predicate predictor described above, the 
COMPARE instruction is provided to the input of pipeline 305 of Figure 3. Within 
pipeline 305, the APV for p2 is determined by performing a full bit comparison of the 
operands R1 and R2. While the COMPARE instruction is being executed in the 
pipeline, but before the APV is determined, the decoded ADD instruction is next 
provided to the predicate predictor from block 300. The predicate ID of p2 is used to 
select the appropriate PPV in SPRF 304. The PPV for p2 is read from SPRF 304 
and is provided to the PPV input of pipeline 305 while the predicated ADD 
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instruction is provided to the instruction input of pipeline 305. If the PPV for p2 is 
"True", the ADD instruction is executed normally. If the PPV for a predicate is 
"False", the instruction is treated as a no-op. Treating an instruction like a no-op 
means that the instruction is either not executed, or, if executed, the resultant data 
is not used to update the architectural state of the register file. 

While the predicated ADD instruction is executing within pipeline 305 of 
Figure 3, the previous COMPARE instruction completes execution and an APV for 
p2 is determined. The APV for p2 is provided from pipeline 305 at the APV output, 
and the IP for the COMPARE instruction is provided at the IP output. The IP is 
transferred to the IP select circuit of predicate history table 301 and is used to select 
the appropriate location in the table into which the APV for p2 is written. This APV 
is used to update the historical information and confidence level associated with p2. 
In addition, the predicate ID of p2 is transferred from the output of pipeline 373 to 
the predicate select circuit of SPRF 304 to select the appropriate location in the file 
from which the PPV for p2 is read. This PPV is compared to the APV for p2 via 
XOR gate 306 to determine if predicate p2 was accurately predicted (i.e. the APV 
matches the PPV) or was mispredicted (i.e. the APV does not match the PPV). If 
the PPV for p2 was accurate, instruction execution continues normally. If, however, 
the PPV was mispredicted, a flush signal is sent from XOR gate 306 to pipeline 305, 
causing pipeline 305 to flush the instructions being executed therein. 

In addition to providing the APV for p2 to predicate history table 301 and to 
an input of XOR gate 306 of Figure 3, the APV for p2, along with its predicate ID, is 
provided to the architectural predicate register file (APRF) (not shown) to update the 
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value of predicate p2. The APRF stores non-speculative, architecturally committed 
predicate values, and is accessed by subsequent instructions predicated on p2 to 
determine if the instruction is to be executed or treated like a no-op. Upon providing 
the PPV for p2 to XOR gate 306, SPRF 304 invalidates the entry associated with 
5 p2. In this manner, future access of SPRF 304 by subsequent instructions 

predicated on p2 will result in a miss, forcing the instructions to use the APV for p2 
stored in the APRF. 

Note that pipeline 305 of Figure 3 represents only a portion of the full pipeline 
CJl of the processor. More specifically, pipeline 305 includes the backend portion of the 
$0 pipeline, including the execution stage. Because predicate prediction is performed 
^! near the backend of the pipeline, fewer instructions must be flushed in comparison 
to a conventional mispredicted branch recovery process. If the PPV for p2 is 
mispredicted, the ADD instruction and any subsequent instructions that rely directly 
Cll or indirectly on the incorrect PPV are flushed and re-executed through pipeline 305. 

Figure 4 is computer system formed in accordance with an embodiment of 
the present invention. Processor 400 is coupled to cache 405 and includes pipeline 
401, a backend portion of which is coupled to predicate predictor 402. Bridge 410 is 
coupled to processor 400 via a system bus. Bridge 410 is used to couple processor 
400 to main memory 415 and to peripheral components 420 and 430. Bridge 425 
20 couples keyboard 435, external memory 440, and monitor 445 to bridge 410. 

Peripheral components 420 and 430 of Figure 4 may include audio and video 
input/output devices such as audio/video generators, accelerators, or analyzers. 
External memory 440 may include a hard drive, floppy disk, tape drive, other 
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magnetic storage media, a battery powered random access memory (RAM) device, 
an electrically programmable read only memory (EPROM) storage device, other 
solid-state storage device, a CD-ROM, or other non-volatile, machine-readable, 
storage medium. 

In accordance with one embodiment of the present invention, an operand 
value of a COMPARE instruction, along with the COMPARE instruction itself, is 
initially stored in external memory 440 of Figure 4. During operation of the computer 
system, processor 400 initiates a transfer of the COMPARE instruction and the 
operand from external memory 440 into main memory 415 via bridges 425 and 410. 
The COMPARE instruction and the operand may then be transferred to cache 405 
before being received and used by processor 400, or the COMPARE instruction and 
the operand may be transferred directly from main memory 415 to processor 400 via 
bridge 410. 

Once in pipeline 401 of Figure 4, the COMPARE instruction is decoded. The 
decoded instruction is provided to predicate predictor 402, which is designed to 
operate in cooperation with pipeline 401 in a manner similar to the predicate 
predictor and pipeline described above in conjunction with Figure 3. During 
predicate prediction, the LSBs of the operand are compared to the LSBs of a 
second operand of the COMPARE instruction to calculate a PPV for a predicate. 
For an alternate embodiment of the present invention, the operand is generated as 
the result of a calculation by processor 400, and is subsequently stored in external 
cache 405 or main memory 415. This operand is then recalled by processor 400 for 
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use in executing the COMPARE instruction. Alternatively, the operand may 
originate within a memory location of either peripheral component 420 or 430. 

Figure 5 is a flow chart showing a method of the present invention. At step 
510, a confidence level is determined. This confidence level indicates the 
confidence, as determined by the predicate predictor, in the ability of the predicate 
predictor to accurately predict a predicate based on historical information associated 
with the predicate. At step 515 the predictor determines whether or not the 
calculated confidence level is less than a threshold value. 

If the calculated confidence level is less than a threshold value, then the PPV 
is determined by comparing the LSBs of a first operand to the LSBs of a second 
operand of a COMPARE instruction at step 525. If, however, the calculated 
confidence level is not less than a threshold value, then the PPV is determined 
using historical information commensurate with branch prediction techniques at step 
520. 

This invention has been described with reference to specific exemplary 
embodiments thereof. It will, however, be evident to persons having the benefit of 
this disclosure that various modifications and changes may be made to these 
embodiments without departing from the broader spirit and scope of the invention. 
The specification and drawings are, accordingly, to be regarded in an illustrative 
rather than a restrictive sense. 
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